- Work in a team of software engineers and data engineers responsible for developing, maintaining, and improving our cloud data platform to ingest and process raw and structured data coming from different sources
- Collaborate with data scientists, machine learning engineers, and other data engineers to design scalable, reliable, and maintainable ETL processes that ensure data scientists and automated ML processes have the necessary data available
- Research and adopt the best DataOps & MLOps standards to design and develop scalable end-to-end data pipelines.
- Identify opportunities for data process automation.
- Establish and enforce best practices (e.g. in development, quality assurance, optimization, release, and monitoring).
- Proven experience as a Data Engineer
- Proficiency in Python
- Experience with a Cloud Platform (e.g. Azure, AWS, GCP)
- Experience with Google BigQuery and Google Dataflow
- Experience with Orchestration Frameworks (e.g. Airflow, Composer)
- Experience with Databricks or Spark
- Great communication, teamwork, problem-solving, and organizational skills.
Company
Location
Madrid - Spain
Job type
Full-Time
Python Job Details
We are on a mission to make science open so everyone can live healthy lives on a healthy planet
Who we are
Frontiers is an award-winning open science platform and leading open access scholarly publisher.
We are one of the largest and most cited publishers globally. To date, our 200,000 freely available research articles have received more than 1 billion views and downloads and 2 million citations. Our journals span science, health, humanities and social sciences, engineering, and sustainability. And we continue to expand into new academic disciplines so more researchers can publish open access.
Be part of the publishing revolution and help us transform the way research is published, evaluated, and communicated to the world.
Job Role
We are looking for a Data Engineer to help us build and maintain scalable and resilient pipelines that will ingest, process, and deliver the data needed for predictive and descriptive analytics. These data pipelines provide different stakeholders with the necessary resources to improve our user-centric platform and create the best visibility for our open access research.
Key Responsibilities
Requirements
Benefits
With more than 50 nationalities represented in our global team, you will work regularly with teammates in other countries, and with our community of researchers, editors, and authors from around the globe.
Our mission to create solutions for healthy lives also extends to the working environment we provide for our employees.
This includes:
100% remote working
Employees now have the flexibility to choose where they want to work, with remote working available on a part- or full-time basis (not applicable to some Workplace/IT jobs due to nature of role requiring presence onsite, in the office).
Learning and development
All employees have access to LinkedIn Learning (and Pluralsight for our technology team), an annual personal learning budget, and dedicated L&D time.
Wellbeing
We offer free online yoga classes, an employee assistance plan, access to the Headspace app, and four wellbeing days on top of your annual leave allowance.
Volunteering opportunities
Employees can dedicate three days each year to volunteer for a personal cause or through our volunteering partner platform, Alaya.
Frontiers actively embraces diversity and is a safe and welcoming workplace. Recruitment is free from discrimination – including based on race, national or ethnic origin, age, religion, disability, sex, gender identity or sexual orientation. With over 600 employees from more than 50 different nations, our diversity creates vibrant teams and constantly challenges us to appreciate multiple perspectives.
Job Type: Full-time
More Developer Job Boards
Fullstack Developer Jobs Golang Jobs JavaScript Jobs Python Jobs React Jobs Rust Jobs Java Jobs